Information processing device and information processing method

ABSTRACT

The present disclosure proposes a new and improved information processing device and information processing method capable of reducing user&#39;s uncomfortable feeling upon changing an image displayed in a three-dimensional virtual space. According to the present disclosure, there is provided an information processing device including a control unit that performs control to display, with a user&#39;s first-person viewpoint, a three-dimensional virtual space where a viewed target image is arranged to change the viewed target image while fixing a peripheral image of the viewed target image. The viewed target image is a target to be viewed by a user.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a U.S. National Phase of International PatentApplication No. PCT/JP2018/015961 filed on Apr. 18, 2018, which claimspriority benefit of Japanese Patent Application No. JP 2017-101479 filedin the Japan Patent Office on May 23, 2017. Each of the above-referencedapplications is hereby incorporated herein by reference in its entirety.

TECHNICAL FIELD

The present disclosure relates to an information processing device, aninformation processing method, and a program.

BACKGROUND ART

Patent Document 1 discloses a technology for arranging a subject imageand a panoramic image in a three-dimensional virtual space anddisplaying the images with a user's viewpoint (i.e., first-personviewpoint).

CITATION LIST Patent Document

Patent Document 1: Japanese Patent Application Laid-Open No. 2013-97094

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

By the way, in a case where all of such images displayed with thefirst-person viewpoint are changed at the same period of time, the usersometimes feels uncomfortable about the change of the images. Such anuncomfortable feeling may appear as so-called motion sickness.

Therefore, the present disclosure proposes a new and improvedinformation processing device, information processing method, andprogram capable of reducing user's uncomfortable feeling upon changingan image displayed in a three-dimensional virtual space.

Solutions to Problems

According to the present disclosure, there is provided an informationprocessing device including a control unit that performs control todisplay, with a user's first-person viewpoint, a three-dimensionalvirtual space where a viewed target image is arranged, and performscontrol to change the viewed target image while fixing a peripheralimage of the viewed target image, the viewed target image being a targetto be viewed by a user.

According to the present disclosure, there is provided an informationprocessing method including, under the control of a processor,displaying a three-dimensional virtual space where a viewed target imagewhich is to be viewed by a user is arranged, with a user's first-personviewpoint, and moving the viewed target image while fixing a peripheralimage of the viewed target image.

According to the present disclosure, there is provided a program forcausing a computer to achieve a control function of performing controlto display, with a user's first-person viewpoint, a three-dimensionalvirtual space where a viewed target image is arranged, and performingcontrol to change the viewed target image while fixing a peripheralimage of the viewed target image, the viewed target image being a targetto be viewed by a user.

According to the present disclosure, a viewed target image on which theuser's attention is expected to be focused is changed and a peripheralimage surrounding the viewed target image is fixed. Thus, it is possibleto reduce the user's uncomfortable feeling.

Effects of the Invention

As described above, according to the present disclosure, it is possibleto reduce the user's uncomfortable feeling, when changing an imagedisplayed in a three-dimensional virtual space. Note that the effectsare not necessarily limited to the above description, and the presentdisclosure may have any of the effects described herein or other effectsconceivable from the present description in addition to or instead ofthe above effects.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an explanatory diagram illustrating an example of a use stateof an information processing system according to an embodiment of thepresent disclosure.

FIG. 2 is a block diagram illustrating a configuration of a controldevice.

FIG. 3 is a block diagram illustrating a configuration of a displaydevice.

FIG. 4 is a flowchart illustrating an example of processing by theinformation processing system.

FIG. 5 is a flowchart illustrating an example of processing by theinformation processing system.

FIG. 6 is an explanatory diagram illustrating an example of a display onthe display device.

FIG. 7 is an explanatory diagram illustrating an example of a display onthe display device.

FIG. 8 is an explanatory diagram illustrating an example of a display onthe display device.

FIG. 9 is an explanatory diagram illustrating an example of a display onthe display device.

FIG. 10 is an explanatory diagram illustrating an example of a displayon the display device.

FIG. 11 is an explanatory diagram illustrating an example of a displayon the display device.

FIG. 12 is an explanatory diagram illustrating an example of a displayon the display device.

FIG. 13 is an explanatory diagram illustrating an example of a displayon the display device.

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the accompanying drawings. Notethat in the present description and the drawings, components havingsubstantially the same functional configurations will be denoted by thesame reference numerals and redundant description will be omitted.

Note that description will be given in the following order.

1. Configuration of information processing system

1-1. Overall configuration

1-2. Configuration of control device

1-3. Configuration of display device

2. First display control process

3. Second display control process

<1. Configuration of Information Processing Device>

(1-1. Overall Configuration)

Firstly, the overall configuration of an information processing system 1according to the present embodiment will be described with reference toFIG. 1. As illustrated in FIG. 1, the information processing system 1includes a control device (information processing device) 10, a displaydevice 20, and a communication cable 30.

The control device 10 arranges an actual scene image in athree-dimensional virtual space. Then, the control device 10 causes thedisplay device 20 to display, with a user's first-person viewpoint, thethree-dimensional virtual space in which the actual scene image isarranged. Specifically, the control device 10 sets a virtual user'sviewpoint which is a user's viewpoint in the virtual space and generatesa display image seen from the virtual user's viewpoint. Here, thevirtual user's viewpoint is specified on the basis of attitude detectioninformation transmitted from the display device 20. The attitudedetection information is generated by an attitude detection unitincorporated in the display device 20. “An image seen from the virtualuser's viewpoint” means an image seen in a user's field of view in thevirtual space. Then, the control device 10 causes the display device 20to display a display image.

The display device 20 includes a so-called head-mounted display (HMD)and is mounted around the eyes of a person U (user). Then, theabove-described display image is displayed on the display device 20.Then, when the virtual user's viewpoint changes due to operation by theuser (e.g., face movement, instruction operation for “forward movement”,or the like), the display image changes according to the operation.Therefore, the user can enjoy a virtual experience as if the user existsin an actual scene.

Note that the control device 10 and the display device 20 may beintegrally constituted. For example, the display device 20 may have thefunction of the control device 10. Furthermore, the display device 20 isnot limited to a head-mounted display and may be another type ofdisplay. For example, the display device 20 may include a stationarydisplay or a display of a portable terminal (e.g., mobile phone,smartphone, smart tablet, portable game device, or the like). In thiscase, the attitude detection unit can be achieved by providing animaging device, for example, for the display or the portable terminal.

Incidentally, in a case where the whole of the display image is changedin accordance with the change in the virtual user's viewpoint at thesame period of time, the user sometimes feels uncomfortable with thechange of the actual scene image. For example, in a case where theactual scene image is moved along a road image in the actual sceneimage, the user may have an illusion that the user is moving even thoughhe/she is not moving actually. As a matter of course, it can be saidthat the technology for displaying the actual scene image with thefirst-person viewpoint is a technology for entertaining the user withsuch an illusion. However, such an illusion may make some users have anuncomfortable feeling. In addition, such an uncomfortable feeling maycause so-called motion sickness. Furthermore, the image displayed withthe first-person viewpoint frequently changes, which may also cause theuser to feel uncomfortable. In particular, since the head-mounteddisplay is used as the display device 20, an image is displayed overalmost whole of the user's field of view. Therefore, it is assumed thatthis configuration is highly likely to make the user have theuncomfortable feeling.

The present inventor considered that the user's uncomfortable feelingmay be caused due to an individual's visual characteristic. In otherwords, a person focuses his/her attention on a specific region,including his/her viewpoint, of an image seen in the person's field ofview. Therefore, even if the image is changed in this region, it isconsidered that the user does not often feel uncomfortable. On the otherhand, if there is a change in an image outside the region on which theuser focuses his/her attention, it is considered that there is a highpossibility that the user feels uncomfortable. Furthermore, also in acase where there is a change unexpected to the user, it is consideredthat there is a high possibility that the user has an uncomfortablefeeling.

Therefore, the present inventor studied a technology for reducing theuncomfortable feeling of the user. Firstly, the present inventorsstudied a teleport technique. For example, assuming that the virtualuser's viewpoint moves from a certain point to another in athree-dimensional virtual space in which the actual scene image isarranged, the actual scene image seen from the virtual user's viewpointbeing moving is displayed on the display device 20. In other words, theactual scene image is displayed in the state of changing. The user mayfeel uncomfortable with such change. Therefore, in the teleporttechnique, immediately after displaying the actual scene image of thecertain point, the actual scene image of the other point is displayed.However, in this technique, it is difficult for the user to grasp aspatial image during the movement. Furthermore, it is difficult for theuser to get the sense of distance between the points.

Next, the present inventors studied a technique for superimposing afixed image (such as a vehicle cockpit image, for example) on a displayimage. It can be expected that such a fixed object seen in a user'sfield of view may reduce the user's uncomfortable feeling. However, thistechnique may degrade realism, reducing the user's feeling of experienceof exploration.

Next, the present inventor studied a technique for clearly displayingonly a region of a display image on which the user is expected to focushis/her attention and blurring or hiding the peripheral regiontherearound. However, this technique reduces the amount of informationobtained from the display image. Furthermore, the user's feeling ofimmersion is reduced.

Next, the present inventor studied a third-person viewpoint. In thistechnique, a person image corresponding to the user is arranged in avirtual space, and a region including the person image is displayed witha third-person viewpoint. This technique can be also expected to reducethe uncomfortable feeling of the user. However, this technique degradesthe user's feeling that the user is moving by himself/herself.

As described above, any of the above techniques considerably degrade thevirtual experience provided for the user. Therefore, in the presentembodiment, while changing an image (e.g., a moving viewpoint image 230.See a first display control process, which is described later) in aregion on which the user is expected to focus his/her attention, theperipheral image out of the region is fixed. Furthermore, change of animage (e.g., movement of a character image P. See a second displaycontrol process, which is described later) causes the user to predictthe next change of the image. Thus, the user can enjoy the virtualexperience with a reduced uncomfortable feeling. Hereinafter, theinformation processing system according to the present embodiment willbe described in detail.

(1-2. Configuration of Control Device)

Next, the configuration of the control device 10 will be described withreference to FIGS. 1 and 2. The control device 10 includes acommunication unit 11, a storage unit 12, and a control unit 13. Thecontrol device 10 includes, as a hardware configuration, a centralprocessing unit (CPU), namely a processor, a random access memory (RAM),a read only memory (ROM), a hard disk, a communication device, and thelike. In the ROM, information, such as programs, necessary forprocessing by the control device 10 is recorded. The CPU reads andexecutes a program stored in the ROM.

The communication unit 11 includes, for example, a communication deviceand communicates with the display device 20 via the communication cable30. Furthermore, the communication unit 11 is also capable ofcommunicating with other information processing devices via a network,which is not illustrated, and may acquire, for example, an actual sceneimage, a map image, and the like through the communication. The actualscene image is an image obtained by imaging an actual scene. Thecommunication unit 11 outputs information obtained each time thecommunication unit 11 communicates with the display device 20, to thecontrol unit 13. Furthermore, the communication unit 11 transmitsinformation, for example, a display image, provided from the controlunit 13 to the display device 20.

The storage unit 12 includes, for example, a ROM, a RAM, a hard disk,and the like and stores information necessary for processing by thecontrol device 10. For example, the storage unit 12 stores programs,various images, and the like. Here, the images stored in the storageunit 12 include an actual scene image, a map image, and the like.

The control unit 13 includes, for example, a CPU or the like andcontrols each component of the control device 10. Furthermore, thecontrol unit 13 generates a display image to be displayed on the displaydevice 20 and outputs the display image to the communication unit 11.Although detailed description thereof will be given later, for example,the control unit 13 arranges the actual scene image in athree-dimensional virtual space. Next, the control unit 13 sets avirtual user's viewpoint which is a user viewpoint in the virtual spaceand generates the display image seen from the virtual user's viewpoint.

(1-3. Configuration of Display Device)

Next, the configuration of the display device 20 will be described withreference to FIGS. 1 and 3. The display device 20 includes acommunication unit 21, an attitude detection unit 22, a display unit 23,and a display control unit 24. The display device 20 includes, as ahardware configuration, a central processing unit (CPU), namely aprocessor, a random access memory (RAM), a read only memory (ROM), anattitude detection sensor, a head-mounted display device, acommunication device, and the like. In the ROM, information, such asprograms, necessary for processing by the display device 20 is recorded.The CPU reads and executes a program stored in the ROM.

The communication unit 21 includes, for example, a communication device,and the like and communicates with the control device 10 via thecommunication cable 30. The communication unit 21 outputs information,for example, a display image, obtained each time the communication unit21 communicates with the control device 10, to the display control unit24. Furthermore, the communication unit 21 transmits information, forexample, attitude detection information, which will be described later,provided from the display control unit 24 to the control device 10.

The attitude detection unit 22 includes, for example, an attitudedetection sensor and detects the attitude of the display device 20. Theattitude detection sensor may be, for example, a gyro sensor. Theattitude detection unit 22 generates attitude detection informationrelating to the attitude of the display device 20 and outputs thegenerated attitude detection information to the display control unit 24.Here, the attitude of the display device 20 changes depending on theorientation of the user's head. Then, the user's viewpoint can beroughly identified on the basis of the orientation of the user's head.Therefore, in the present embodiment, the attitude detection informationis used to specify the virtual user's viewpoint. As described above, thevirtual user's viewpoint is specified on the basis of the attitudedetection information from the attitude detection unit 22. Therefore,the user can move the virtual user's viewpoint by changing theorientation of the user's head.

Here, the attitude detection sensor may be a line-of-sight detectionsensor (i.e., an imaging device for imaging the image of the vicinity ofthe user's eye) for detecting a user's line of sight. In this case, theattitude detection sensor can directly detect the line of sight of theuser. Furthermore, the user can move the virtual user's viewpoint bychanging the line of sight.

Furthermore, the information processing system 1 may include an inputoperation device capable of receiving an input operation from the user.The control unit 13 may move the virtual user's viewpoint on the basisof input operation information given from the input operation device.

Furthermore, the information processing system 1 may also include asensor (e.g., an imaging device) for detecting the posture of the entireuser's body. Then, the control unit 13 may specify the virtual user'sviewpoint on the basis of detection information provided from thesensor. In other words, in this case, the control unit 13 integrallyuses the orientations of the face, body, and line of sight of the user.

The display unit 23 includes, for example, a head-mounted display deviceand displays a display image or the like under the control of thedisplay control unit 24.

The display control unit 24 includes, for example, a CPU or the like andcontrols each component of the display device 20. Furthermore, thedisplay control unit 24 causes the display unit 23 to display thedisplay image provided from the communication unit 21. Furthermore, thedisplay control unit 24 outputs the attitude detection informationprovided from the attitude detection unit 22 to the communication unit21.

(2. First Display Control Process)

Next, display control performed by the control unit 13 of the controldevice 10 will be described in detail. The control unit 13 performscontrol to display, with a user's first-person viewpoint, athree-dimensional virtual space where a viewed target image is arranged.The viewed target image is a target to be viewed by a user. Then, thecontrol unit 13 performs control to change the viewed target image whilefixing a peripheral image of the viewed target image. Specifically, thecontrol unit 13 performs a first display control process and a seconddisplay control process. Note that the control unit 13 performs thefirst display control process and the second display control process,and meanwhile the display device 20 transmits the attitude detectioninformation described above to the control device 10.

Firstly, the first display control process will be described withreference to FIGS. 4 and 6 to 12. In step S10, the control unit 13arranges a map image 100 in the three-dimensional virtual space. Here,the map image 100 may be stored in the storage unit 12 in advance or maybe acquired from another information processing device by thecommunication unit 11. The control unit 13 may allow the user to selectthe map image 100 to be arranged in the three-dimensional virtual space.In this case, for example, the control unit 13 causes the display device20 to display a display image list having listed candidates of the mapimage. Specifically, the control unit 13 outputs the display image listto the communication unit 11, and the communication unit 11 transmitsthe display image list to the display device 20. The communication unit21 of the display device 20 outputs the received display image list tothe display control unit 24. The display control unit 24 causes thedisplay unit 23 to display the display image list. All of the processingof “causing the display device 20 to display the image” are performed inthe same manner as described above.

The display image list may use any list as long as the user can perceivethe map image 100. For example, the display image list may be a list ofthumbnails or the like of map images, a list of place names, or acombination thereof. The user selects a desired map image 100 from thedisplay image list. A washing method therefor is not particularlylimited but may include, for example, a selection method by using aninput operation device, which is not illustrated, a selection method byusing a virtual user's viewpoint, or the like. In the latter method, thecontrol unit 13 causes the display device 20 to display the virtualuser's viewpoint, which will be described later, together with thedisplay image list.

Next, the control unit 13 sets one or a plurality of target points(i.e., a checkpoint) on the map image 100. Here, each of the targetpoints may be, but is not limited to, for example, a point having alandmark. The target point may be set by the user. Next, the controlunit 13 arranges target point images 110 indicating the target points,on the map image. Furthermore, in the vicinity of any of the targetpoint images 110, a goal image 120 indicating that the target point is afinal target point may be disposed. In FIG. 6, the goal image 120 isarranged in the vicinity of a target point image 110 c. Furthermore, thecontrol unit 13 may cause the user to select a time slot. Then, thecontrol unit 13 may set a target point on the basis of the time slotselected by the user. For example, depending on a time slot selected bythe user, there may be a landmark which is not in business (closed).Therefore, the control unit 13 may be configured not to set a landmarkwhich is not in business as a target point.

Furthermore, the control unit 13 arranges a character image(following/moving image) P on the map image 100 as a viewed targetimage. An initial position of the character image P is not particularlylimited. Although detailed description thereof will be given later, thecharacter image P is also referred to as a puppet image or the like.Note that in this embodiment, an image imitating a person is referred toas the character image P, but the character image P may have any othershape. An image other than the character image P may be used as thefollowing/moving image.

Furthermore, the control unit 13 specifies the virtual user's viewpointas a user viewpoint in the virtual space, on the basis of the attitudedetection information. Then, the control unit 13 arranges a virtualuser's viewpoint image Q indicating the virtual user's viewpoint, in thethree-dimensional virtual space.

Next, the control unit 13 generates an image seen from the virtualuser's viewpoint, that is, an image seen in a user's field of view inthe virtual space, as a display image. Then, the control unit 13 causesthe display device 20 to display the display image. Thus, the controlunit 13 causes the display device 20 to display, with the user'sfirst-person viewpoint, the map image 100 and each image (the targetpoint images 110, character image P, or the like) on the map image.Furthermore, the control unit 13 receives the attitude detectioninformation at any time and generates a display image on the basis ofthe attitude detection information. Then, the control unit 13 causes thedisplay device 20 to display the display image. Thus, the user can viewthe map image 100 and each image (the target point images 110, characterimage P, or the like) on the map image while freely moving the virtualuser's viewpoint in the three-dimensional virtual space.

In step S20, the control unit 13 determines whether or not the user isgazing at any of the target point images 110. For example, the controlunit 13 determines whether or not the virtual user's viewpoint image Qis on the target point image 110 for a predetermined time period orlonger. In a case where it is determined that the user is gazing at anyof the target point images 110, the control unit 13 proceeds to stepS30, and in a case where it is determined that the user is not gazing atthe target point image 110, the control unit 13 finishes this process.

In step S30, the control unit 13 acquires an actual scene image 300(i.e., a scene image. See FIG. 9) corresponding to the target pointimage 110 at which the user is gazing. Such an actual scene image 300may be stored in the storage unit 12 or may be acquired from anotherinformation processing device by the communication unit 11. Hereinafter,a target point image 110 which the user is gazing at is also referred toas a “gaze point image”. Furthermore, a target point indicated by thegaze point image is also referred to as a “gaze point”.

In step S40, the control unit 13 moves the character image P onto thegaze point image. In other words, the control unit 13 moves thecharacter image P following the virtual user's viewpoint. An example isillustrated in FIG. 7. In this example, the user is gazing at a targetpoint image 110 a, and the character image P is moved onto the targetpoint image 110 a. Thus, the user's attention can be concentrated on thecharacter image P. Note that while the character image P moves, the mapimage 100 is fixed. In other words, the control unit 13 performs controlto display, with the user's first-person viewpoint, thethree-dimensional virtual space where the viewed target image (here, thecharacter image P) is arranged. The viewed target image is a target tobe viewed by the user. Furthermore, the control unit 13 performs controlto change the viewed target image (here, the character image P is moved)while fixing the peripheral image (here, the map image 100) of theviewed target image. In other words, the control unit 13 changes onlythe character image P on which the user's attention is expected to befocused but fixes the peripheral image. Thus, it can be expected thatthe user's uncomfortable feeling is reduced.

Here, the control unit 13 may change the moving speed of the characterimage P according to the user's skill level (the number of times ofexecution of the first display control process, and the like). Forexample, the control unit 13 may increase the moving speed of thecharacter image P as the user has a higher skill level. Even if thecontrol unit 13 displays the character image P in such a manner, it isexpected that the user having a higher skill level can understand adisplay content.

Then, the control unit 13 displays the actual scene image (scene image)300 in the three-dimensional virtual space around the character image P,but if the actual scene image 300 is suddenly displayed, the user mayfeel uncomfortable. This is because the user may not be able to expectsuch change of the image.

Therefore, before displaying the actual scene image 300, the controlunit 13 performs control to notify the user of such display. Forexample, as illustrated in FIG. 8, the control unit 13 causes thecharacter image P positioned on the gaze point image (here, the targetpoint image 110 a) to look back to the user side. Thus, the control unit13 causes the user to expect future image change (i.e., some change ofthe image relating to the gaze point image). Therefore, even if theactual scene image 300 is displayed in the three-dimensional virtualspace around the character image P, the user unlikely has anuncomfortable feeling. As a matter of course, the method for notifyingthe user is not limited to this description, and any method may be usedas long as the method can attract the user's attention. For example,some kind of notification sound may be output from the display device20. Furthermore, a plurality of sound source output portions may beprovided in the display device 20, and the notification sound may beoutput from different output positions depending on the gaze point.Thus, the user's attention to the gaze point can be further enhanced.

Note that the control unit 13 may omit the movement of the characterimage P and notification process described above in response to aselection operation or the like by a user. This is because a user whohardly feels uncomfortable (i.e., a user who hardly gets motionsickness) in change of the image may have a desire to immediately viewthe actual scene image 300.

Next, the control unit 13 zooms in to the character P from the virtualuser's viewpoint. In other words, the map image and the character P areenlarged with the character P as the center. Note that when suchenlargement processing is suddenly performed, there is a possibilitythat the user may feel uncomfortable, but as described above, the usernotified thereof in advance hardly feels uncomfortable.

Here, when the virtual user's viewpoint deviates from the character Pand returns to the character P again, the control unit 13 may perform azoom-in process from the virtual user's viewpoint. The zoom-in processmay be omitted.

In step S50, as illustrated in FIG. 9, the control unit 13 arranges theactual scene image 300 in the three-dimensional virtual space around thecharacter image P. Then, the control unit 13 generates a display imageseen from the virtual user's viewpoint. Note that the virtual user'sviewpoint (i.e., where the viewpoint is in the actual scene image 300)at this time is preferably set in advance. Then, the control unit 13causes the display device 20 to display the display image. Thus, theuser can view the actual scene image 300. Thereafter, the control unit13 erases the character image P and map image 100 and proceeds to thesecond display control process. Note that when the actual scene image300 is to be displayed, the character image P and map image 100 may beerased immediately.

(1-2-2. Second Display Control Process)

Next, the second display control process will be described withreference to FIGS. 5 to 12. In step S60, as illustrated in FIG. 10, thecontrol unit 13 arranges the actual scene image 300 (the actual sceneimage 300 corresponding to the gaze point image; so-called scene images)in the three-dimensional virtual space. Therefore, it can be said thatthe actual scene image 300 is a three-dimensional image. Furthermore,the control unit 13 receives the attitude detection information at anytime and specifies the virtual user's viewpoint on the basis of theattitude detection information. Then, the control unit 13 arranges thevirtual user's viewpoint image Q indicating the virtual user'sviewpoint, in the three-dimensional virtual space.

Furthermore, the control unit 13 specifies a target point image 110(hereinafter also referred to as an “immediate target point image”)closest to the gaze point image. In the example of FIG. 7, the immediatetarget point image is the target point image 110 b. Hereinafter, atarget point indicated by the immediate target point image is alsoreferred to as an “immediate target point”. Next, the control unit 13generates a moving viewpoint image 230 illustrated in FIGS. 12 and 13.Here, the moving viewpoint image 230 is an actual scene image seen fromthe virtual user's viewpoint being moving from the gaze point to theimmediate target point. FIGS. 12 and 13 illustrate one scene (imagedisplayed at a certain point of time during reproduction of the movingviewpoint image 230) of the moving viewpoint image 230.

For example, the control unit 13 may acquire a plurality of capturedimages captured at points in a route from the gaze point to theimmediate target point and generate the moving viewpoint image 230 onthe basis of the captured images. These captured images may be stored inthe storage unit 12 or may be acquired from another informationprocessing device by the communication unit 11. It can be said that themoving viewpoint image 230 indicates a route from the gaze point to theimmediate target point.

The moving viewpoint image 230 may indicate a route to a target pointother than the immediate target point. Furthermore, the control unit 13may select a plurality of target points and generate a moving viewpointimage 230 corresponding to each of the target points. Furthermore, themoving viewpoint image 230 may be a planar image or may be athree-dimensional image as in the actual scene image 300. Furthermore,the moving viewpoint image 230 may be a time-lapse movie. In otherwords, the control unit 13 may continuously display still images. Thesestill images may be planar images or three-dimensional images. In a casewhere the moving viewpoint image 230 is the planar image or thetime-lapse movie, the data volume of the moving viewpoint image 230 canbe reduced. From the viewpoint of the data volume, it is preferable thatthe moving viewpoint image 230 be the time-lapse movie and the stillimages constituting the time-lapse movie be planar images.

Next, the control unit 13 arranges an image display frame 200illustrated in FIG. 11 in the three-dimensional virtual space. Here, themoving viewpoint image 230 and the like are displayed in the imagedisplay frame 200. For example, the control unit 13 arranges the imagedisplay frame 200 at a position corresponding to an intersection of theroute from the gaze point to the immediate target point with a region inthe three-dimensional virtual space where the actual scene image 300 isarranged. Thus, the user can easily understand from which position inthe actual scene image 300 the user can move to the immediate targetpoint. In a case where a plurality of moving viewpoint images 230 isgenerated, the control unit 13 arranges an image display frame 200corresponding to each of the moving viewpoint images 230 in thethree-dimensional virtual space.

Here, the control unit 13 may adjust the size of the image display frame200 according to the distance from the gaze point to the immediatetarget point. For example, the control unit 13 may reduce the size ofthe image display frame 200 as the distance from the gaze point to theimmediate target point increases. Thus, the user can grasp the sense ofdistance to the immediate target point. Note that the control unit 13may return the size of the image display frame 200 to a preset sizeduring reproduction of the moving viewpoint image 230. This is becauseif the image display frame 200 is too small, it may become difficult forthe user to view the moving viewpoint image 230.

Furthermore, the control unit 13 arranges a symbol image in the imagedisplay frame 200. Here, the symbol image is an image indicating thatthe moving viewpoint image 230 is displayed in the image display frame200. FIG. 11 illustrates an example of the symbol image. In the exampleillustrated in FIG. 11, the control unit 13 arranges, as the symbolimage, a play button image 210 and a thumbnail image 220 in the imagedisplay frame 200. The thumbnail image 220 may be the first scene (imageto be displayed first) of the moving viewpoint image 230. Furthermore,the symbol image may be a landmark image indicating a landmark existingat the immediate target point. In this case, the user can readilyunderstand what kind of landmark exists at the immediate target point.Furthermore, the symbol image may be omitted. In this case, displayingthe actual scene image 300 also in the image display frame 200 resultsin continuous display of the actual scene image 300 inside and outsidethe image display frame 200. This configuration causes the user to viewa natural image. However, in this case, it is difficult for the user tounderstand where the image display frame 200 is. Therefore, the controlunit 13 may highlight (e.g., color, or the like) the image display frame200.

Next, the control unit 13 generates a display image seen from thevirtual user's viewpoint and causes the display device 20 to display thedisplay image. Furthermore, the control unit 13 receives the attitudedetection information at any time and generates a display image on thebasis of the attitude detection information. Then, the control unit 13causes the display device 20 to display the display image. In otherwords, the control unit 13 performs control to display, with the user'sfirst-person viewpoint, the three-dimensional virtual space in which theactual scene image 300 and the like are arranged. Thus, the user canview the actual scene image 300 and the symbol image while freely movingthe virtual user's viewpoint in the three-dimensional virtual space.Therefore, the user can enjoy a virtual experience as if the user is ina real scene.

In step S70, the control unit 13 determines whether or not the user isgazing at the symbol image. For example, the control unit 13 determineswhether or not the virtual user's viewpoint image Q is on the symbolimage for more than a predetermined time period. FIG. 11 illustrates astate in which the virtual user's viewpoint image Q is on the symbolimage. In a case where the control unit 13 determines that the user isgazing at the symbol image, the process proceeds to step S80, and in acase where the control unit 13 determines that the user is not gazing atthe symbol image, the process is finished.

In step S80, as illustrated in FIGS. 12 and 13, the control unit 13displays (reproduces) the moving viewpoint image 230 in the imagedisplay frame 200. Here, the control unit 13 fixes the peripheral image(i.e., the actual scene image 300) of the image display frame 200 whilethe moving viewpoint image 230 is being displayed (reproduced). In otherwords, the control unit 13 performs control to display, with the user'sfirst-person viewpoint, the three-dimensional virtual space where theviewed target image (here, the moving viewpoint image 230) is arranged.The viewed target image is a target to be viewed by the user.Furthermore, the control unit 13 performs control to change the viewedtarget image (here, reproduce the moving viewpoint image 230) whilefixing the peripheral image (here, the actual scene image 300 positionedaround the image display frame 200) of the viewed target image. Thus,the user can readily understand the atmosphere (characteristics in theroute, direction of movement, distance of movement, time period ofmovement, and the like) of the route from the gaze point to theimmediate target point.

Here, the control unit 13 may change a display mode of the movingviewpoint image 230 according to the skill level of the user (the numberof times of reproducing the moving viewpoint image 230, or the like).For example, the control unit 13 may increase the display speed(reproduction speed) of the moving viewpoint image 230 as the user has ahigher skill level. Furthermore, in a case where the moving viewpointimage 230 is displayed (reproduced) in the form of time-lapse, thenumber of still images used for the moving viewpoint image 230 may bereduced. Even if the control unit 13 displays the moving viewpoint image230 in such a manner, the user having a higher skill level is expectedto understand the contents of the moving viewpoint image 230.

Furthermore, the control unit 13 may omit the reproduction of the movingviewpoint image 230 in response to a selection operation or the like bya user. This is because a user who hardly feels uncomfortable (i.e., auser who hardly gets motion sickness) in change of the image may have adesire to immediately view a next scene image.

Furthermore, in a case where the moving viewpoint image 230 shows aperson therein, a reproduction mode of the moving viewpoint image 230may be changed depending on the number of persons. For example, thedisplay speed (reproduction speed) of the moving viewpoint image 230 maybe reduced as the number of person images in the moving viewpoint image230 increases. This is because it is expected that the more time takesfor the user to grasp the route, as the number of people in the movingviewpoint image 230 increases. Furthermore, the control unit 13 mayprepare a plurality of kinds of moving viewpoint images 230 captured indifferent time slots to display a moving viewpoint image 230 selected bythe user. Thus, the user can grasp the atmosphere of each time slot.Furthermore, the control unit 13 may display the moving viewpoint image230 captured in a time slot in which there are a smaller number ofpeople. In this case, the user can more readily understand theatmosphere of the route.

Furthermore, when the virtual user's viewpoint is out of the movingviewpoint image 230 during reproduction of the moving viewpoint image230, the control unit 13 may cancel the reproduction of the movingviewpoint image 230 and return the state in the image display frame 200to an initial state (i.e., a state in which the symbol image isdisplayed).

Thereafter, the control unit 13 repeats the second display controlprocess with the immediate target point as the gaze point. In otherwords, an actual scene image (scene image) at the immediate target pointis arranged in the three-dimensional virtual space. As described above,in the present embodiment, the moving viewpoint image 230 in the imagedisplay frame 200 is reproduced first, and then the whole of the displayimage including the peripheral image becomes a next scene image. In thisregard, for example, in a case where the whole display image is set asthe moving viewpoint image 230, the user may feel uncomfortable.However, in the present embodiment, the moving viewpoint image 230 isdisplayed only in the image display frame 200, that is, only in theregion which the user is gazing at, and the peripheral image thereof isfixed. Therefore, the user hardly feels uncomfortable duringreproduction of the moving viewpoint image 230.

Here, the control unit 13 may display the actual scene image of theimmediate target point when the virtual user's viewpoint falls in theimage display frame 200 again, instead of immediately after thereproduction of the moving viewpoint image 230.

Furthermore, in the embodiment described above, although the actualscene image is arranged in the three-dimensional virtual space, anothertype of image, for example, a scene image artificially created may bearranged. For example, the present embodiment may be applied to a gameor the like in which three-dimensional display is performed. In thiscase, both of the map image and the moving viewpoint image are alsogenerated on the basis of the scene image artificially generated. Evenin the game in which a three-dimensional display is performed, the usermay have uncomfortable feeling as described above. Therefore,performance of the process according to the present embodiment enablesreduction of the user's uncomfortable feeling.

As described above, according to the present embodiment, the controlunit 13 performs control to display, with the user's first-personviewpoint, a three-dimensional virtual space where a viewed target image(e.g., the character image P and the moving viewpoint image 230) isarranged. The viewed target image is a target to be viewed by the user.Then, the control unit 13 performs control to change the viewed targetimage while fixing the peripheral image (e.g., the map image 100 and theactual scene image 300) of the viewed target image. In other words, thecontrol unit 13 changes the viewed target image on which the user'sattention is expected to be concentrated and fixes the peripheral image.Thus, it is possible to reduce the user's uncomfortable feeling.Furthermore, since this process does not change the quality of theperipheral image, the user can enjoy the virtual experience.

Furthermore, the control unit 13 changes the viewed target image in amanner associated with a direction in which the virtual user's viewpointmoves. Specifically, the control unit 13 moves the character image P(following/moving image) following the virtual user's viewpoint.Furthermore, the control unit 13 displays an image seen from the virtualuser's viewpoint being moving, as the moving viewpoint image 230. Evenin such a case, since the peripheral image is fixed, the user'suncomfortable feeling can be reduced.

Furthermore, since the control unit 13 arranges the actual scene image300 in the three-dimensional virtual space, the user can enjoy thevirtual experience as if the user exists in a real scene. Here, thecontrol unit 13 may arrange, for example, a scene image artificiallycreated in the three-dimensional virtual space. In this case, the usercan enjoy the virtual experience as if the user him/herself in thecreated scene.

Furthermore, the control unit 13 sets a plurality of target points inthe three-dimensional virtual space. For example, the control unit 13sets a plurality of target points on the map image arranged in thethree-dimensional virtual space. Then, the control unit 13 arranges ascene image corresponding to any one of the target points (e.g., theuser's gaze viewpoint) in the three-dimensional virtual space. Then, thecontrol unit 13 performs control to display, as the moving viewpointimage 230, a scene image seen from the virtual user's viewpoint beingmoving from one target point to another target point (e.g., theimmediate target point). Thus, the user can readily understand theatmosphere of a route from the one target point to the other targetpoint. Furthermore, in a case where the other target point is theimmediate target point, the user can readily understand the atmosphereof a route to the immediate target point.

Furthermore, the control unit 13 arranges the symbol image in the imagedisplay frame 200, performing control to display the moving viewpointimage 230 when the virtual user's viewpoint overlaps the symbol image.Therefore, the user can readily understand that the moving viewpointimage 230 is displayed at which position in the three-dimensionalvirtual space.

Furthermore, since the control unit 13 arranges, as the symbol image,the landmark image indicating a landmark existing at another targetpoint, the user can readily understand what kind of landmark exists atthe other target point.

Furthermore, the control unit 13 arranges the image display frame 200 ata position corresponding to an intersection of a route from one targetpoint to another target point with a region where the actual scene image300 is arranged. Therefore, the user can readily understand from whichposition in the actual scene image 300 the user can move to the othertarget point.

Furthermore, the control unit 13 displays the moving viewpoint image 230as a planar image. Thus, the data volume of the moving viewpoint image230 can be reduced.

Furthermore, the control unit 13 displays the moving viewpoint image 230in the form of time-lapse. Thus, the data volume of the moving viewpointimage 230 can be reduced.

Furthermore, in a case where the virtual user's viewpoint overlaps thetarget point image 110, the control unit 13 overlaps the character imageP on the target point image 110. Next, the control unit 13 performscontrol to display the actual scene image 300 of the target point (i.e.,the gaze point) in the three-dimensional virtual space around thecharacter image P. Therefore, the control unit 13 moves the characterimage P before displaying the actual scene image 300, and thus, the usercan expect future image change. Therefore, even if the actual sceneimage 300 is displayed in the three-dimensional virtual space around thecharacter image P, the user unlikely has an uncomfortable feeling.

Furthermore, the control unit 13 performs control to notify the userthat the actual scene image 300 of the target point (i.e., the gazepoint) is to be displayed, before the actual scene image 300 isdisplayed in the three-dimensional virtual space around the characterimage P. For example, the control unit 13 performs control to output anotification sound. This makes it possible to cause the user to expectfuture image change.

As described above, preferable embodiments of the present disclosure hasbeen described in detail with reference to the accompanying drawings,but the technical scope of the present technology is not limited tothese examples. Those skilled in the art may obviously find variousalternations and modifications within the technical ideas as set forthin the scope of the appended claims, and it should be understood thatthey will naturally come under the technical scope of the presentinvention.

Furthermore, the effects described herein are merely illustrative anddemonstrative and are not limitative. In other words, the technologyaccording to the present disclosure can exhibit, along with or insteadof the effects, other effects apparent to those skilled in the art fromthe description herein.

Note that the present technology may also be configured as follows.

(1)

An information processing device including a control unit that performscontrol to display, with a user's first-person viewpoint, athree-dimensional virtual space where a viewed target image is arrangedand performing control to change the viewed target image while fixing aperipheral image of the viewed target image, the viewed target imagebeing a target to be viewed by a user.

(2)

The information processing device according to (1), in which the controlunit changes the viewed target image in a manner associated with adirection in which a virtual user's viewpoint set in thethree-dimensional virtual space moves.

(3)

The information processing device according to (2), in which the controlunit arranges a scene image in the three-dimensional virtual space.

(4)

The information processing device according to (3), in which the sceneimage includes an actual scene image obtained by imaging an actualscene.

(5)

The information processing device according to (3) or (4), in which thecontrol unit arranges an image display frame in the three-dimensionalvirtual space and performs control to display, in the image displayframe, as the viewed target image, a moving viewpoint image seen fromthe virtual user's viewpoint being moving.

(6)

The information processing device according to (5), in which the controlunit sets a plurality of target points in the three-dimensional virtualspace, arranges the scene image corresponding to any one of the targetpoints in the three-dimensional virtual space, and performs control todisplay, as the moving viewpoint image, the scene image seen from thevirtual user's viewpoint being moving from the one target point toanother target point.

(7)

The information processing device according to (6), in which the controlunit sets the other target point as a target point closest to the onetarget point.

(8)

The information processing device according to (6) or (7), in which thecontrol unit arranges a symbol image in the image display frame andperforms control to display the moving viewpoint image when the virtualuser's viewpoint overlaps the symbol image.

(9)

The information processing device according to (8), in which the controlunit arranges, as the symbol image, a landmark image indicating alandmark existing at the other target point.

(10)

The information processing device according to any of (6) to (9), inwhich the control unit arranges the image display frame at a positioncorresponding to an intersection of a route from the one target point tothe other target point with a region where the scene image is arranged.

(11)

The information processing device according to any of (5) to (10), inwhich the control unit displays the moving viewpoint image as a planarimage.

(12)

The information processing device according to any of (5) to (11), inwhich the control unit displays the moving viewpoint image in a form oftime-lapse.

(13)

The information processing device according to any of (2) to (12), inwhich the control unit arranges a map image in the three-dimensionalvirtual space.

(14)

The information processing device according to (13), in which thecontrol unit performs control to display, as the viewed target image, afollowing/moving image moving on the map image while following thevirtual user's viewpoint.

(15)

The information processing device according to (14), in which thecontrol unit arranges a target point image indicating a target point, onthe map image.

(16)

The information processing device according to (15), in which in a casewhere the virtual user's viewpoint overlaps the target point image, thecontrol unit overlaps the following/moving image on the target pointimage, and then, performs control to display a scene image of the targetpoint in the three-dimensional virtual space around the following/movingimage.

(17)

The information processing device according to (16), in which thecontrol unit performs control to notify the user that the scene image ofthe target point is to be displayed, before the scene image is displayedin the three-dimensional virtual space around the following/movingimage.

(18)

An information processing method wherein, a processor performs controlto display a three-dimensional virtual space where a viewed target imagewhich is to be viewed by a user is arranged, with a user's first-personviewpoint, and performs control to change the viewed target image whilefixing a peripheral image of the viewed target image.

(19)

A program for causing

a computer to achieve a control function of

performing control to display, with a user's first-person viewpoint, athree-dimensional virtual space where a viewed target image is arrangedand performing control to change the viewed target image while fixing aperipheral image of the viewed target image, the viewed target imagebeing a target to be viewed by a user.

REFERENCE SIGNS LIST

-   1 Information processing system-   10 Control device-   11 Communication unit-   12 Storage unit-   13 Control unit-   20 Display device-   21 Communication unit-   22 Attitude detection unit-   23 Display unit-   24 Display control unit-   30 Communication cable-   100 Map image-   110 Target point image-   P Character image-   Q Virtual user's viewpoint image-   200 Image display frame-   210 Play button image-   220 Thumbnail image-   230 Moving viewpoint image-   300 Actual scene image

The invention claimed is:
 1. An information processing device,comprising: a central processing unit (CPU) configured to: control,based on a first viewpoint of a user, a display screen to display athree-dimensional virtual space, wherein the three-dimensional virtualspace includes a viewed target image, the viewed target imagecorresponds to a target viewable by the user, and the first viewpoint ofthe user corresponds to a viewpoint in a real space; and based on amovement of a second viewpoint of the user, the display screen todisplay a movement of the viewed target image from a first target pointof a plurality of target points in the three-dimensional virtual spaceto a second target point of the plurality of target points whileperipheral image of the viewed target image is fixed, wherein the secondviewpoint of the user corresponds to a viewpoint in thethree-dimensional virtual space.
 2. The information processing deviceaccording to claim 1, wherein the CPU is further configured to control,based on a direction of the movement of the second viewpoint of the userin the three-dimensional virtual space, the display screen to displaythe movement of the viewed target image.
 3. The information processingdevice according to claim 2, wherein the CPU is further configured tocontrol the display screen to display a scene image in thethree-dimensional virtual space.
 4. The information processing deviceaccording to claim 3, wherein the scene image corresponds to an image ofan actual scene.
 5. The information processing device according to claim3, wherein the CPU is further configured to: control the display screento display an image display frame in the three-dimensional virtualspace; and control the display screen to display, in the image displayframe, as the viewed target image, a movement of a moving viewpointimage from the second viewpoint of the user.
 6. The informationprocessing device according to claim 5, wherein the CPU is furtherconfigured to: set the plurality of target points in thethree-dimensional virtual space; control the display screen to displaythe scene image corresponding to one of the plurality of target pointsin the three-dimensional virtual space; and control the display screento display, as the moving viewpoint image, a movement of the scene imagefrom the second viewpoint from the first target point to the secondtarget point.
 7. The information processing device according to claim 6,wherein the CPU is further configured to set the second target pointclosest to the first target point among the plurality of target points.8. The information processing device according to claim 6, wherein theCPU is further configured to: control the display screen to display asymbol image in the image display frame; and control, based on thesecond viewpoint that overlaps the symbol image, the display screen todisplay the moving viewpoint image.
 9. The information processing deviceaccording to claim 8, wherein the CPU is further configured to controlthe display screen to display, as the symbol image, a landmark imagethat indicates a landmark at the second target point.
 10. Theinformation processing device according to claim 6, wherein the CPU isfurther configured to control the display screen to display the imagedisplay frame at a position corresponding to an intersection of a routefrom the first target point to the second target point with a region inthe three-dimensional virtual space, the region includes the sceneimage.
 11. The information processing device according to claim 5,wherein the CPU is further configured to control the display screen todisplay the moving viewpoint image as a planar image.
 12. Theinformation processing device according to claim 5, wherein the CPU isfurther configured to control the display screen to display the movingviewpoint image in a form of time-lapse.
 13. The information processingdevice according to claim 2, wherein the CPU is further configured tocontrol the display screen to display a map image in thethree-dimensional virtual space.
 14. The information processing deviceaccording to claim 13, wherein the CPU is further configured to controlthe display screen to display, as the viewed target image, a movement ofa moving image on the map image.
 15. The information processing deviceaccording to claim 14, wherein CPU is further configured to control thedisplay screen to display a target point image that indicates a targetpoint on the map image.
 16. The information processing device accordingto claim 15, wherein the CPU is further configured to: control, based onthe second viewpoint that overlaps the target point image, the displayscreen to display the moving image on the target point image; andcontrol the display screen to display a scene image of the target pointin the three-dimensional virtual space around the moving image.
 17. Theinformation processing device according to claim 16, wherein the CPU isfurther configured to control the display screen to notify the user thatthe scene image of the target point is to be displayed, before the sceneimage is displayed in the three-dimensional virtual space around themoving image.
 18. An information processing method, comprising:controlling, based on a first viewpoint of a user, a display screen todisplay a three-dimensional virtual space, wherein the three-dimensionalvirtual space includes a viewed target image, the viewed target imagecorresponds to a target viewable by the user, and the first viewpoint ofthe user corresponds to a viewpoint in a real space; and controlling,based on a movement of a second viewpoint of the user, the displayscreen to display a movement of the viewed target image from a firsttarget point of a plurality of target points in the three-dimensionalvirtual space to a second target point of the plurality of target pointswhile a peripheral image of the viewed target image is fixed, whereinthe second viewpoint of the user corresponds to a viewpoint in thethree-dimensional virtual space.
 19. A non-transitory computer-readablemedium having stored thereon computer-executable instructions which,when executed by a central processing unit (CPU) of an informationprocessing device, cause the CPU to execute operations, the operationscomprising: controlling, based on a first viewpoint of a user, a displayscreen to display a three-dimensional virtual space, wherein thethree-dimensional virtual space includes a viewed target image, theviewed target image corresponds to a target viewable by the user, andthe first viewpoint of the user corresponds to a viewpoint in a realspace; and controlling, based on a movement of a second viewpoint of theuser, the display screen to display a movement of the viewed targetimage from a first target point of a plurality of target points in thethree-dimensional virtual space to a second target point of theplurality of target points while a peripheral image of the viewed targetimage is fixed, wherein the second viewpoint of the user corresponds toa viewpoint in the three-dimensional virtual space.